Clench activated switch system

ABSTRACT

Systems and methods for operating a controlled device via an activation accessory that includes a vibration motor, a wearable module including a clench-detection sensor (e.g., a Hall effect sensor), and a communication element. The sensor is coupled to a controller, which has an output coupled to a control signal interface and another output coupled to the vibration motor. The controller is programmed to receive and evaluate input signals from the sensor to determine whether or not they represent a command for the controlled device by assessing the input signals for a signal pattern indicative of a plurality of volitional jaw clench actions of a wearer of the wearable module. If/when the processor determines that the input signals represent the command, then it decodes the command and transmits an associated control signal to the controlled device via the control signal interface as well as an activation signal to the vibration motor.

RELATED APPLICATIONS

This application is a Continuation of U.S. patent application Ser. No.17/247,976, filed 4 Jan. 2021, now U.S. Pat. No. 11,553,313, which is anonprovisional of and claims priority to U.S Provisional ApplicationNos. 62/705,524, filed 2 Jul. 2020, and 63/110,463, filed 6 Nov. 2020,each of which is incorporated by reference herein.

FIELD OF THE INVENTION

The present invention relates to systems and methods for operating acontrolled device in a hands-free manner through volitional jaw clenchactions of a wearer.

BACKGROUND

It is common for aviators, especially those operating militaryfixed-wing aircraft, to wear respiration systems that include a mask andfor such masks to include therein control switches that can bemanipulated by the wearer using his/her lip or tongue. For example, U.S.Pat. No. 7,184,903 describes a hands-free, mouth-activated switchdisposed within a cup-shaped, rigid portion of a pilot's oxygen mask.Among the elements controllable by such a switch is a night visioncompatible light.

While such systems are common, they do not provide complete solutionsfor an entire aircraft crew. For example, not all crew members may wearor even have access to oxygen masks or such masks as include these typesof switches. Moreover, it is highly unusual for civilian aircraft crewsto have such masks as employ mouth-activated switches. Even if themask-fitted, mouth-activated switches are employed, use thereof demandsthat the mask be worn. This would not be typical of flight crew memberswhen embarking or disembarking the aircraft. Hence, the associatedcontrolled systems (e.g., illumination systems) are predictablyunavailable for use during these activities.

SUMMARY OF THE INVENTION

Embodiments of the invention include systems and methods for operating acontrolled device, such as an illumination element having one or morelight emitting diodes (LEDs), a push-to-talk (PTT) adapter for a two-wayradio, or a two-way radio itself. In one example, an activationaccessory for a controlled device includes a vibration motor, a wearablemodule including a Hall effect sensor, and a communication element. Thewearable module includes a Hall effect sensor that is communicablycoupled to a controller, which has a first output coupled to a controlsignal interface and a second output coupled to the vibration motor. Thecontroller includes a processor and a memory coupled thereto and whichstores processor-executable instructions that, when executed by theprocessor, cause the processor to receive and evaluate input signalsfrom the Hall effect sensor. In particular, the controller evaluates theinput signals to determine whether or not they represent a command forthe controlled device by assessing the input signals for a signalpattern indicative of a plurality of volitional jaw clench actions of awearer of the wearable module. If/when the processor determines that theinput signals represent the command, then it decodes the command andtransmits an associated control signal to the controlled device via thecontrol signal interface as well as an activation signal to thevibration motor. On the other hand, if the processor determines that theinput signals do not represent the command, no control signal oractivation signal is transmitted and the processor proceeds to evaluatefurther/new input signals from the Hall effect sensor in a like manneras the original input signals. The communication element is coupled tothe control signal interface and is adapted to transmit the controlsignal from the processor to the controlled device. For example, thecommunication element may be a cable having a plug configured to matewith a jack at the controlled device, or a transmitter adapted for radiofrequency communication with a receiver at the controlled device.Depending on the implementation, the activation signal for the vibrationmotor may be a pulse width modulated signal.

In various embodiments, the wearable module may be supported in a mountof a headset, or another arrangement. For example, such a mount may bemoveable with respect to a frame of the headset so as to permit locatingthe wearable module at different positions on the wearer. Moregenerally, such a mount may be configured to position the wearablemodule so as to be overlying an area of the wearer's masseter muscle. Insome cases, the wearable module may be supported in a mask (e.g., a maskused by a firefighter, a diver, an aircrew member, of another wearer),where the mask is configured to position the wearable module so as to beoverlying an area of the wearer's masseter muscle. Alternatively, thewearable module may have an adhesive applied to a surface thereof toenable the wearable module to be worn on the face or head of the wearer.Such an adhesive may, in one case, be in the form of a removeable filmadhered to the surface of the wearable module.

The wearable module may include more than one Hall effect sensor, withthe multiple sensors arranged with respect to one another so as topermit individual and/or group activation thereof by associatedvolitional jaw clench actions of the wearer. Further, in addition to thevibrational motor, a visual activation indicator may be present. Such avisual activation indicator (e.g., an LED) may be coupled to receive avisual activation indication signal from the controller and theprocessor-executable instructions, when executed by the processor, mayfurther cause the processor to perform transmit the visual activationindication signal to the visual activation indicator if/when theprocessor determines that the first input signals represent the command.

When assessing the input signals from the Hall effect sensor for thesignal pattern indicative of a plurality of volitional jaw clenchactions of the wearer, the processor may evaluate the input signalsagainst a stored library of command signal representations, where eachcommand signal representation characterizes an associated command forthe controlled device. Alternatively, or in addition, the input signalsmay be assessed according to respective power spectral densities thereofwithin specified time periods. Or the input signals may be assessedaccording to count values of the Hall effect sensor(s) received within aspecified time period. Still further, the input signals may be evaluatedagainst a trained model of command signal representations, where eachcommand signal representation characterizes an associated command forthe controlled device.

These and still more embodiments of the invention are described indetail below with reference to the accompanying drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention is illustrated by way of example, and notlimitation, in the figures of the accompanying drawings, in which:

FIG. 1 illustrates an example of an activation accessory for acontrolled device configured in accordance with an embodiment of thepresent invention.

FIGS. 2A-2F illustrate examples of devices operated under the control ofan activation accessory configured in accordance with an embodiment ofthe present invention.

FIG. 3 illustrates an example of an activation accessory secured in aheadset mount configured in accordance with an embodiment of the presentinvention.

FIG. 4 illustrates an example of an activation accessory secured in amask, in accordance with an embodiment of the present invention.

FIG. 5 illustrates an example of an activation accessory having a filmof adhesive on one surface for attachment to a wearer.

FIG. 6 illustrates an example of an activation accessory such as thatshown in FIG. 5 as secured to the face of a wearer by adhesive.

FIG. 7 illustrates an example of an activation accessory for acontrolled device configured with multiple Hall effect sensors, inaccordance with an embodiment of the present invention

FIGS. 8A-8D show examples of arrangements for securing wearable moduleof an activation accessory to a headset earphone cup, in accordance withembodiments of the present invention.

FIG. 9 illustrates an example of an input signal received by a processorof a wearable module from Hall effect sensor of the wearable module, inaccordance with embodiments of the present invention.

FIG. 10 illustrates a method of operating a controlled device in ahands-free manner through volitional jaw clench actions of a wearer, inaccordance with an embodiment of the invention.

FIGS. 11A-11B, 12A-12B, 13A-13B, and 14A-14B illustrate variousembodiments of head-worn visioning devices with wearable modulesconfigured in accordance with embodiments of the present invention.

DETAILED DESCRIPTION

Described herein are systems and methods for hands-free operation ofcontrolled devices, for example illumination systems, push-to-talksystem, and other devices. These systems and methods are characterized,in part, by employing a switch element, e.g., a Hall effect sensor, thatis positioned on or near the face of a user, overlying the area of theuser's masseter muscle so that clenching/flexing of the jaw activatesthe switch. In one embodiment, the switch element is employed incombination with a headset or mask suitable for wear in a variety ofcontexts, including military, law enforcement, health care, and others(e.g., consumer). The headset or mask positions the switch element sothat it overlies an area of the wearer's masseter muscle so thatclenching/flexing of the wearer's jaw activates the switch, therebyallowing for hand-free operation of the controlled device. Otherembodiments of the invention make use of the switch element as part ofother head-worn illumination, imaging, and/or communication systems. Insome instances, the switch element may be positioned in locations otherthan over the wearer's masseter muscle, allowing activation/deactivationby means of muscles associated with a wearer's eyebrow, temple, etc.

As used herein, when referencing an area of a wearer's face overlyingthe masseter muscle, we mean that wearable module or a wearableelectronic controller having one or more active control surfaces (e.g.,Hall effect sensors, electromyography (EMG) sensors, piezo switches,etc.) is positioned to contact the right (and/or) left side of thewearer's face within an area below the ear canal to the bottom of themandible and extending forward beneath the zygomatic arch, which isformed between the zygomatic process of the temporal bone and thetemporal process of the zygomatic bone, and the zygomatic bone. Theactive control surfaces are configured to detect a relaxed condition anda flexed condition of the wearer's masseter muscle(s) (see, e.g., FIG. 9), thereby allowing the wearer to generate input signals for controllingelectronic system components via masseter muscle manipulation. Thewearable module or electronic controller is adjustable in terms of thepositioning of one or more of the active control surfaces within thearea(s) overlying a portion of the wearer's masseter muscle(s) and meansfor adjusting the contact pressure of the active control surfacesagainst the wearer's face may be provided. The wearable module may beconstructed to house one or more of the electronic system components(e.g., lights, cameras, displays, laser pointers, a haptic engine in theform of a vibration motor, etc.) that is being controlled by massetermuscle manipulation.

The use of “clench interactions” has been recognized as a viable controltechnique. For example, the present applicant's U.S. PGPUB 2020/0097084,Xu et al., “Clench Interaction: Novel Biting Input Techniques,” Proc.2019 CHI Conference on Human Factors in Computing Systems (CHI 2019),May 4-9, 2019, Glasgow, Scotland UK, and Koshnam, E. K. et al.,“Hands-Free EEG-Based Control of a Computer Interface based on OnlineDetection of Clenching of Jaw,” in: Rojas I., Ortuño F. (eds)Bioinformatics and Biomedical Engineering, IWBBIO 2017, pp. 497-507(Apr. 26-28, 2017) all provide examples of such techniques. In Xu etal., the use of bite force interfaces may afford some advantages in someapplications, however, the present invention adopts a different approachinasmuch as it relies on sensors placed outside a user's oral cavity.Such sensors are more suitable for applications where the presence ofsensors inside one's mouth may be uncomfortable or impractical. InKoshnam et al., the EEG sensors were external to the oral cavity, havingbeen placed at temporal sites T7 and T8 on the wearer's head, but therewas no provision for alerting the wearer when a command signal wasrecognized as having been initiated through a jaw clench action.Accordingly, the system was perceived as having excessive lag time inrecognizing and implementing a clench action, which adversely impactedits use as a control element for a remote device.

Referring to FIG. 1 , an example of an activation accessory 10 for acontrolled device is shown. The activation accessory 10 includes avibration motor 12, a wearable module 14 that includes a Hall effectsensor 16, and a controller 18. Hall effect sensor 16 is communicablycoupled to controller 18 through an analog-to-digital converter 20,which converts the analog output of the Hall effect sensor 16 to adigital signal that is provided as an input to a processor 22 of thecontroller. Processor 22, in turn, has outputs coupled to a controlsignal interface 24 and the vibration motor 12.

The processor 22 of controller 18 is also coupled to a memory 26, whichstores processor-executable instructions that, when executed byprocessor 22, cause processor 22 to receive and evaluate input signalsfrom the Hall effect sensor 16. Controller 18 (i.e., processor 22)evaluates the input signals to determine whether or not they represent acommand for the controlled device by assessing the input signals for asignal pattern indicative of a plurality of volitional jaw clenchactions of a wearer of the wearable module 14. As more fully discussedbelow, if/when the processor 22 determines that the input signals fromHall effect sensor 16 represent the command for the controlled device,then processor 22 decodes the command and transmits an associatedcontrol signal to the controlled device (not shown in this view) via thecontrol signal interface 24, as well as transmitting an activationsignal to the vibration motor 12. On the other hand, if the processor 22determines that the input signals from Hall effect sensor 16 do notrepresent the command for the controlled device, no control signal oractivation signal is transmitted and processor 22 proceeds to evaluatefurther/new input signals from the Hall effect sensor 16 in a likemanner as the original input signals. In one embodiment, the activationsignal for the vibration motor is a pulse width modulated signal. Thehaptic feedback provided by vibration motor 12 in response to jaw clenchactions of a wearer may also be activated by another user (e.g., througha communication to the wearer of wearable module 14) to provide a meansfor silent communication.

Referring now to FIGS. 2A-2F, various examples of controlled devices andarrangements for coupling same to the wearable module 14 are shown. InFIG. 2A, the controlled device is an illumination element 30 made up ofone or more LEDs 32. As indicated above, the processor of controller 18is coupled to the control signal interface 24 and is adapted to transmita control signal to the controlled device, in this case illuminationelement 30, via the control signal interface 24. Not shown in theillustration are drivers and other interface elements that may bepresent to amplify and/or otherwise condition the control signal so thatit is suitable for use with the illumination element 30.

FIG. 2B illustrates an example in which the wearable module 14 iscoupled to a transmitter 34 via the control signal interface 24.Transmitter 34 may be a low power/short range transmitter, such as aBluetooth™, Bluetooth Low Energy (BLE), Zigbee, infrared, WiFi HaLow(IEEE 802.22h), Z-wave, Thread, SigFox, Dash7, or other transmitter. Thetransmitter 34 may itself be the controlled device or, alternatively, asshown in FIG. 2D, the transmitter 34 may be one component of a wirelesscommunication system that includes a receiver 36 communicatively coupledto a controlled device, such as two-way radio 38. In such anarrangement, transmitter 34 is adapted for radio frequency communicationwith receiver 36 at the controlled device. Thus, the control signalissued by processor 22 of controller 18 is coupled to the control signalinterface 24 and transmitted via a radio frequency signal fromtransmitter 34 to the controlled device.

FIG. 2C shows a further alternative in which the wearable module 14 iscoupled directly to two-way radio 38. In this example, the controlsignal interface 24 may be coupled to the two-way radio 38 by a cablehaving a plug configured to mate with a jack at the two-way radio 38(or, more generally, the controlled device). As such, the wearablemodule 14 may function as a push-to-talk (PTT) unit for the two-wayradio 38 (or, more generally, an activation switch for the controlleddevice). Or, as shown in FIGS. 2E and 2F, the wearable module 14 mayfunction as an ancillary PTT element for a PTT adapter 40 for thetwo-way radio 38 (or, more generally, the controlled device). Theconnection between the wearable module 14 (control signal interface 24)and the PTT adapter 40 may be wired, as shown in FIG. 2E, e.g., using acable having a plug configured to mate with a jack at the PTT adapter,or wireless, using a transmitter/receiver pair 34, 36. Of course, otherarrangements for communicating the control signal produced by theprocessor 22 (or, more generally, controller 18) of the wearable module10 to a controlled device may be used.

In addition to the above-described examples, the processor 22 may alsocommunicate with and control other peripherals, such as a heads-updisplay, audio input/output unit, off-headset unit, etc. Processor 22 isa hardware-implemented module and may be a general-purpose processor, ordedicated circuitry or logic, such as a field programmable gate array(FPGA) or an application-specific integrated circuit (ASIC)), or otherform of processing unit. Memory 26 may be a readable/writeable memory,such as an electrically erasable programmable read-only memory, or otherstorage device.

Referring now to FIG. 3 , in various embodiments, the wearable module 10may be supported in a mount 42 of a headset 44, or another arrangement.For example, such a mount 42 may be moveable with respect to a frame 46of the headset or a component thereof, such as earcup 48, so as topermit locating the wearable module 14 at different positions on thewearer. More generally, such a mount 42 may be configured to positionthe wearable module 14 so as to be overlying an area of the wearer'smasseter muscle.

In some cases, as shown in FIG. 4 , the wearable module 14 may besupported in a mask 52 (e.g., a mask used by a firefighter, a diver, anaircrew member, of another wearer), where the mask 52 is configured toposition the wearable module 14 so as to be overlying an area of thewearer's masseter muscle. Alternatively, as shown in FIG. 5 , thewearable module 14 may have an adhesive applied to a surface thereof toenable the wearable module 14 to be worn on the face or head of thewearer (see, e.g., FIG. 6 ). Such an adhesive may, in one case, be inthe form of a removeable film 54 adhered to the surface of the wearablemodule 14.

The wearable module 14 may include more than one Hall effect sensor 16,with the multiple sensors arranged with respect to one another so as topermit individual and/or group activation thereof by associatedvolitional jaw clench actions of the wearer. For example, FIG. 7illustrates a wearable module 14′ that includes two Hall effect sensors16-1, 16-2. Each Hall effect sensor is associated with a respectivepaddle switch 56-1, 56-2, which can be depressed through a volitionaljaw clench action of the wearer. Depressing a paddle switch will causeits associated Hall effect sensor to be activated.

Further, as shown in FIGS. 1, 3, 4, and 6 , in addition to thevibrational motor 12, a visual activation indicator 50 may be present.Such a visual activation indicator, e.g., one or more LEDs, may becoupled to receive a visual activation indication signal from thecontroller 18 (processor 22) and the processor-executable instructionsstored in memory 26, when executed by processor 22, may further causeprocessor 22 to transmit the visual activation indication signal to thevisual activation indicator 50 so as to illuminate the one or more LEDsfor a brief period of time if/when the processor 22 determines that theinput signals from the Hall effect sensor 16 signals represent acommand. As shown in the various illustrations, the visual activationindicator 50 may be located on the headset 44, on a helmet 60 or anindicator panel 62 associated therewith, or as an attachment, integralor otherwise, to a pair of glasses 64 or goggles, e.g., on the templepieces 66 thereof. An activation indicator of this kind is especiallyuseful when the wearable module 14 is used to control devices such asPTT controllers/adapters associated with tactical radios or the radiosthemselves. When providing microphone actuation when using such radios,a “microphone status LED” may be included in visual activation indicator50 to provide a visual awareness of microphone condition. This LED emitslight inside of the eyeglasses 64 which is visible only by the wearer.This provides effective light discipline in the tactical situations.Light would be visible when the microphone is in use (i.e., open) andwould be extinguished when the microphone is not in use (i.e., off).

In the various embodiments, wearable module 14 is positioned so as to beflush against the wearer's face (or nearly so), over the masseter muscleso that clenching/flexing of the jaw activates the Hall effect sensor16. Power supply and control electronics for the wearable module 14 maybe incorporated within the module itself, and/or in a frame or mask thatsupports the wearable module 14 or elsewhere. In the arrangement shownin FIG. 3 , the wearable module 14 is mounted to the earphone cup 48 ofheadset 44 by means of a frame 46 about the circumference of theearphone cup. In alternative arrangements, such as those shown in FIGS.8A-8D, the frame 46 may be mounted to the earphone cup 48 by means offriction fit frame 46-1, a frame 46-2, 46-3, 46-4 that is fitted bymeans of a screw 68, a rivet or pin 70, or other attachment means. Insome embodiments, the wearable module 14 may be attached to orintegrated in a moveable portion of mount 42 that is rotatable about arivet, pin or other joint or hinge and may also be flexible so as to bemoved adjacent to or away from a wearer's face. This is useful toprevent unwanted actuations of Hall effect sensor 16. Such a moveableportion of mount 42 may be hingibly attached to a frame 46 by aspring-loaded hinge that keeps the wearable module 14 against thewearer's face even when the wearer moves his/her head unless moved awayfrom the wearer's face by an amount sufficient to engage a detent thatprevents return to a position adjacent a wearer's face unless manuallyadjusted by the wearer. Such a hingible arrangement may incorporate aspring-loaded hinge of any type, for example a spring-loaded pianohinge, butt hinge, barrel hinge, butterfly hinge, pivot hinge, or otherarrangement.

Returning to FIG. 6 , illumination element 50 can be attached to theinside of eyeglass temples 66 or slipped over a temple piece to contactthe wearer's temple area when the eyeglasses are worn. This alsoprovides a convenient location for vibration motor 12. From thisposition on the user, when the processor of wearable module 14 detectsvolitional facial movements of the wearer, such as clenching of thewearer's masseter muscle, which is then turned into a command signal,for activating, deactivating, or controlling a controlled device (e.g.,changing the volume of audio communications or music, turning onintegrated lighting modules, or answering a phone call) the vibrationmotor 12 may be activated to provide feedback that indicates successfulrecognition of the input command. As discussed below, a distinct “clenchlanguage” may be programmed to control certain functions of thecontrolled device using specific masseter muscle clench sequences orpatterns. The vibration motor 12 may also provide haptic feedback to theuser as notification of microphone status or other enabled systems. Forexample, light vibrations of vibration motor 12 in a specific patternmay alert the wearer that a microphone is open, so as to prevent an“open-mic” situation where others are prevented from communicating overa common channel.

Further, additional sensors such as for wearer vital signs monitoringmay also be integrated into the temple 66 to provide remotebiomonitoring of the wearer, as the temple area has been proven to be aneffective location for sensing certain vital signs. Such sensors may beintegrated into the eyeglass temples 66, permanently attached as anaccessory, or attached to the inside of the temple using adhesive tape,glue, magnets, hook and loop fasteners, screws, or a tongue and grooveor dovetail profile connection mechanism. The sensor signal may berouted through a powered cable/tether or via a wireless connection suchas Bluetooth or Near Field Magnetic Induction.

As should be apparent from the above discussion, use of the activationaccessory does not require donning a headset or mask. Instead, theactivation accessory can be worn by itself, e.g., through use of anadhesive. Incorporating the activation accessory in headsets wouldtypically be the norm for any member of an aircraft flight or operationscrew, but headsets such as the one illustrated in the above-referencedfigures are not restricted to use by flight/aircraft crews and may beemployed by ground forces, naval/coast guard personnel, and civilians.For example, headsets such as the ones described herein may be employedby workers in and around constructions sites, sports arenas, film andtelevision production locations, amusement parks, and many otherlocations. By employing headgear equipped with activation accessoriessuch as those described herein, wearers thereof have ready access toactivation/deactivation/operation of illumination, imaging, gaming,and/or communications system(s)) in a hands-free fashion. Note thatalthough FIG. 3 illustrates a headset with both left and right earphonecups, this is for purposes of example only and the present system may beused with headsets having only a single earphone cup, or one or twoearpieces. Indeed, the present system may be used even with headgearthat does not include any earphones or earpieces, for example attachedto a band worn on the head or neck, or on a boom of a helmet or otherheadgear.

When assessing the input signals from the Hall effect sensor(s) 16 for asignal pattern indicative of a plurality of volitional jaw clenchactions of the wearer, the processor 22 may evaluate the input signalsagainst a stored library of command signal representations, where eachcommand signal representation characterizes an associated command forthe controlled device. Alternatively, or in addition, the input signalsmay be assessed according to respective power spectral densities thereofwithin specified time periods. Or the input signals may be assessedaccording to count values of the Hall effect sensor(s) received within aspecified time period. Still further, the input signals may be evaluatedagainst a trained model of command signal representations, where eachcommand signal representation characterizes an associated command forthe controlled device.

An example of an input signal received by processor 22 from Hall effectsensor 16 is illustrated in FIG. 9 . Trace 72 depicts “counts” of theHall effect sensor 16 received by processor 22 over time. In thiscontext, the counts, represent the applied magnetic field detected bythe Hall effect sensor 16 which varies with the jaw clench actions ofthe wearer. Other output parameters that can be measured to providesimilar results include voltage and/or current. More generally, inembodiments of the present invention the wearable module of theactivation accessory 10 includes one or more switch elements (Halleffect sensor(s) 16 or other(s) of the sensors discussed herein) thatis/are sensitive to movements of a wearer's masseter muscle and whichare communicatively coupled to controller 18 having processor 22 andmemory 26 coupled thereto and storing processor-executable instructions.Processor 22 is further coupled to provide an output signal to anindicator, such as illumination element 50 and/or vibration motor 12.The wearable module 16 may be fitted to a head- or face-worn article(e.g., a headset, mask, or eyeglasses/goggles, as described below) by anelongated member so as to be positionable to allow the one or morecontrol surfaces associated with the one or more switch elements tocontact a side of the wearer's face within an area below the wearer'sear canal to a bottom of the wearer's mandible and extending forwardbeneath the wearer's zygomatic arch, the switch elements. Theprocessor-executable instructions stored in memory 26, when executed byprocessor 22, cause the processor to receive input signals from the oneor more switch elements 16, detect relaxed (signal level high in FIG. 9) and clenched (signal level low) conditions (e.g., by level or edgedetection of the input signals) of the wearer's masseter muscles. Fromthese input signals, processor 22 decodes the relaxed and clenchedconditions as commands (74, 76, 78, etc.) for controlling electronicsystem components communicatively coupled to the controller and alertsthe wearer to successful decoding of the commands by providing theoutput signal to the indicator.

As illustrated in FIG. 9 , trace 72 exhibits marked shifts in countvalues corresponding to periods of time when a wearer relaxes (signallevel high) and clenches (signal level low) his/her jaw while wearing awearable module 14. The detection of such actions by processor 22 may beedge-sensitive or level-sensitive. Further, as indicated above, the Halleffect sensor signals may be decoded according to a clench language todiscriminate between activation, deactivation, and operational commandsfor the controlled device. The example shown in FIG. 9 representsdecoded signals representing commands for an illumination unit. Signalgroups 74 and 78, a short clench followed by a long clench, representactivation (“on”) and deactivation (“off”) commands. That is, theillumination module is ordered to change operating state, from a currentstate on or off to an opposite state off or on, respectively, when sucha set of input signals is recognized by the processor 22. Signal group76 represents a command to alter an output characteristic, e.g.,brightness, and corresponds to two short clenches followed by a longclench. The two short clenches signal a change in output and the longclench signals that the brightness of the illumination unit should bevaried, e.g., low to high, during the period of the clench action. Ofcourse, other clench languages for a variety of controlled devices maybe implemented. For example, in addition to double clench inputssignaling a following command input, triple clench inputs may berecognized as signally valid command inputs, different from commandsassociated with a double clench input. Further multiple clench inputsand/or clench-and-hold inputs may also be recognized as signifyingdifferent commands. Such multi-clench inputs are useful for eliminatingunintentional actuations of Hall effect sensor 16, as may be occasionedby involuntary muscle movements or by a wearer chewing food, gum, etc.,or clenching his/her jaw during other activities. Generally, theintended command may be identified by decoding the detected relaxed andclenched conditions of the wearer's masseter muscles according to aclench language that identifies such commands according to a number ofdetected clench actions identified within a time period, for example, anumber of detected short and long (clench-and-hold) clench actionsidentified within a time period. Valid forms of clench inputs may beused to turn on/off lighting elements and/or individual LEDs thereof,adjust the intensity of one or more illuminated LEDs, or to signal otherdesired operations. In general, clench input actuation sequence timings,repetitions, and durations may each be used, individually and/or incombination to specify different command inputs for one or morecontrolled devices.

FIG. 10 illustrates a method 80 of operating a controlled device inaccordance with embodiments of the present invention. At 82, thecontroller 18 receives from the Hall effect sensor 16 in the wearablemodule 14 communicably coupled to the controller, first input signals.At 84, processor 22 of controller 18 evaluates the first input signalsaccording to and by executing processor-executable instructions storedin memory 26 to determine whether or not the first input signalsrepresent a command for the controlled device. As discussed above, thisevaluation 84 proceeds by the processor assessing 86 the first inputsignals for a signal pattern indicative of a plurality of volitional jawclench actions of a wearer of the wearable module 14. If processor 22determines that the first input signals represent the command, step 88,then processor 22 decodes the command 90 (e.g., by identifying the inputsignals as being one of a number of patterns of a clench language, asdescribed above, and transmitting 92 an associated control signal to thecontrolled device via a communication element communicably coupled tothe processor, and transmitting 94 an activation signal to a vibrationmotor of the wearable module. As indicated above, the communicationelement may be a cable having a plug configured to mate with a jack atthe controlled device, a transmitter adapted for radio frequencycommunication with a receiver at the controlled device, or otherelement. Decoding the command signal may involve determining the numberof short clench actions preceding a long clench action to determine thenature of a following one or more long and/or short clench actions, andmay also depend on a current operating state of the controlled device.Otherwise, step 96, the processor 22 does not transmit the controlsignal and the activation signal and instead proceeds to evaluatesecond/next input signals 96 from the Hall effect sensor in a likemanner as the first input signals.

In general, Hall effect sensor 16 is a device that requires little or nomechanical displacement of a control element in order to signal oreffect a change (or desired change) in state of a controlled system.Other examples of such a device which may be used in place of the Halleffect sensor 16 include an EMG sensor or a piezo switch, such as thePiezo Proximity Sensor produced by Communicate AT Pty Ltd. of Dee Why,Australia. Piezo switches generally have an on/off output stateresponsive to electrical pulses generated by a piezoelectric element.The electrical pulse is produced when the piezoelectric element isplaced under stress, for example as a result of compressive forcesresulting from a wearer clenching his/her jaw so that pressure isexerted against the switch. Although the pulse is produced only when thecompressive force is present (e.g., when the wearer's jaw is clenched),additional circuitry may be provided so that the output state of theswitch is maintained in either an “on” or an “off” state until a secondactuation of the switch occurs. For example, a flip-flop may be used tomaintain a switch output logic high or logic low, with state changesoccurring as a result of sequential input pulses from the piezoelectricelement. One advantage of such a piezo switch is that there are nomoving parts (other than a front plate that must deform by a fewmicrometers each time a wearer's jaw is clenched) and the entire switchcan be sealed against the environment, making it especially useful formarine and/or outdoor applications.

Another example is a micro tactile switch. Although tactile switchesemploy mechanical elements subject to wear, for some applications theymay be more appropriate than Hall effect sensors or piezo switchesbecause they provide mechanical feedback to the user (although thehaptic feedback provided by vibration motor 12 also provides anacceptable level of feedback for a user and so may be sufficient in themajority of instances). This feedback can provide assurance that theswitch has been activated or deactivated. Momentary contact tactileswitches may also be used, but because they require continual force(e.g., as provided by clenching one's jaw against the switch), they arebest suited to applications where only a momentary or short engagementof the active element under the control of switch is desired, forexample, signal light flashes, burst transmissions, or other shortduration applications, or where a flip flop is used to maintain anoutput state until a subsequent input is received, as discussed above.Other forms of switches include a ribbon switch (e.g., as made byTapeswitch Corporation of Farmingdale, NY) and conductive printedcircuit board surface elements activated via carbon pucks on an overlaidkeypad.

Further, in various embodiments, the controlled device may consist ofone or more LEDs, which emit light in one or more wavelengths. Further,the controlled device may include one or more cameras for digital stilland/or video imaging. In some instances, a lighting element may be wornon one side of the headset while an imaging system is worn on theopposite side, each being controlled by separate activation accessoriesmounted on respective opposite sides of the headset, or by activationaccessory if the lighting and illumination systems are responsive todifferent command signals, similar to the way in which computer cursorcontrol devices (e.g., touch pads, mice, etc.) may be separatelyresponsive to single, double, triple, or other multiple clicks. Indeed,the activation accessory may itself be used to control a cursor as partof a user-computer interface. For example, any or all of cursor type,cursor movement, and cursor selection may be controlled using a wearablemodule 14 positioned so as to be flush against the wearer's face (ornearly so), over the area of the masseter muscle so thatclenching/flexing of the jaw activates the Hall effect sensor 16.Applications for such uses include computer gaming interfaces, whichtoday commonly include head-worn communication equipment. One or morewearable modules 14 configured in accordance with embodiments of theinvention may be fitted to such headgear (either when manufactured or asan after-market addition) to provide cursor control capabilities.Conventional wired or wireless communication means may be employed toprovide a connection to a console, personal computer, tablet, mobilephone, or other device that serves as the gaming or other host. The useof such human-machine interfaces may find particular application forusers that have no or limited use of their hands and afford them aconvenient means of interacting with a personal computer, tablet, mobilephone, or similar device.

Further, the controlled device(s) may include one or more microphones.Such microphones may be mounted or integral to a headset and make use ofbone conduction transducers for transmission of audio signals.Alternatively, or in addition, wearable module 14 may be used to adjustthe presence, absence, and/or volume of audio played through one or moreearphones or other earpieces. Also, a wearable module 14 may be used tocontrol off-headset equipment, for example, via a wireless transmitter.

One or more of the above-described embodiments may permit signalgeneration via a control surface that can be activated by direct orindirect force, hinged paddle, touch-sensitive surface, or other tactileactuation device. Devices configured in accordance with theseembodiments may employ moveable structures (e.g., paddles) that houseHall effect sensors to detect a change in an electromagnetic field whena corresponding magnet is moved in proximity to the sensor. Such devicesmay be in the form of an accessory to a remote (e.g., hand-held) deviceor fully integrated into a wearable form factor such as eyeglasses andheadsets. Other sensors, as discussed herein, may also be used.

By providing both a left and right activation means (or any number ofthem) which may be configured to allow for input of various commandsequences (e.g., different numbers of activations similar to single-,double- or other mouse clicks), a user may provide different commandsfor an associated device. For example, different command activationsequences may be used for zooming a camera, panning a direction in avirtual/visual environment, or a host of other commands to controlcameras, audio transmissions (volume up or down), etc. In addition tothe foregoing, the use of gyros and/or accelerometers while clenchingand holding can allow for selecting and moving objects in the virtualfield. This is similar to a click-and-hold followed by movement of acursor with a mouse or joystick in that it allows a user to move objects(e.g., icons) around on a virtual desktop, to open menus, and to selectcommands, etc. by clenching and moving one's head. The gyros and/oraccelerometers may be incorporated in wearable module 14 or elsewhere(e.g., in a frame supporting the wearable module).

Referring now to FIGS. 11A-14B, various embodiments of head-wornvisioning devices with wearable modules 14 are illustrated. Suchhead-worn visioning devices are suitable for application in a variety ofcontexts, including military, law enforcement, health care, fieldrepair, and others (e.g., consumer). Unlike hand-held and/or handoperated visioning devices, which typically require the user to use hisor her hands to operate a control unit or console, visioning devicesconfigured in accordance with embodiments of the present invention canbe operated in a hands-free fashion and worn with or without a helmet orother headdress, communication devices, etc. In addition to thevisioning means, the frame carrying the visioning means provides aplatform for audio/video capture and/or communications. For example, oneor more speakers, ear buds, and/or microphones may be provided integralto or attached to the frame. Hands-free operation of the visioningdevices is facilitated using a wearable module 14 that includes a clenchswitch as described above that can be activated when the user clenchesor otherwise manipulates his/her jaw, temple, etc.

FIGS. 11A-11B and 12A-12B illustrate embodiments of a visioning devicein the form of head-worn virtual reality goggles 100 with integratedwearable modules 14 (FIGS. 11A-11B) and attachable wearable modules 14(FIGS. 12A-12B) configured in accordance with the present invention.FIGS. 13A-13B and 14A-14B illustrate embodiments of a visioning devicein the form of head-worn augmented reality glasses 102 with integratedwearable modules 14 (FIGS. 13A-13B) and attachable wearable modules 14(FIGS. 14A-14B) configured in accordance with the present invention. Asshown, the various visioning devices each include a frame 104 worn overthe ears.

In some instances, visioning devices 100, 102 may be personalized to awearer by creating a model, either physical or digital, of the wearer'shead and face and fabricating a visioning device 100, 102 (or just aframe 104) specifically to suit the wearer according to the dimensionsprovided from the model. Modern additive manufacturing processes(commonly known as 3D printing) make such customizations economicallyfeasible even for consumer applications and visioning devices 100, 102(or just frames 104) could readily be produced from images of a wearer'shead and face captured using computer-based cameras and transmitted toremote server hosting a Web service for purchase of the visioningdevice(s) (or frames). For example, following instructions provided bythe Web-based service, a user may capture multiple still images and/or ashort video of his/her head and face. By including an object of knowndimensions (e.g., a ruler, a credit card, etc.) within the field of viewof the camera at the approximate position of the user's head as theimages are captured, a 3D model of the user's head and face can becreated at the server. The user can then be provided with an opportunityto customize a visioning device 100, 102 (or frame 104) to be sized tothe dimensions of the model, selecting, for example, color, materials,the positions over the ears, etc. at which the visioning device 100, 102will be worn. Once the customizations are specified, and paymentcollected, the visioning device specification may be dispatched to amanufacturing facility at which the visioning device is fabricated.

Visioning devices 100, 102 may further support one or more communicationearpieces (not shown) and/or one or more microphones (not shown), theearpiece(s) and microphone(s) allowing for communications to/from thewearer. The earpiece(s) and microphone(s) may be communicativelyconnected to a transceiver carried elsewhere on the wearer's person,either using wired or wireless connections. In other embodiments, theearpiece(s) and/or microphone(s) may be eliminated, and audiocommunications facilitated through bone conduction elements. Portions ofthe illumination devices 100, 102 are in contact with the wearer's head.Hence, rather than an earpiece, a bone conduction headphone that decodessignals from a receiver and converts them to vibrations can transmitthose vibrations directly to the wearer's cochlea. The receiver and boneconduction headphone(s) may be embedded directly in the visioning device100, 102, or in some cases the receiver may be external thereto. One ormore bone conduction headphones may be provided. For example, theheadphone(s) may be similar to bone conduction speakers employed byscuba divers and may consist of a piezoelectric flexing disc encased ina molded portion of the visioning device 100, 102 that contacts thewearer's head just behind one or both ears. Similarly, a bone conductionmicrophone may be provided.

Although not shown in the various views, a power source for theelectronics is provided and may be housed within the visioning device100, 102 or located external thereto (e.g., worn on a vest or beltpack). In some cases, a primary power source may be located external tothe visioning device 100, 102 and a secondary power source providedintegral thereto. This would allow the primary power source to bedecoupled from the visioning device 100, 102 which would then revert tousing the secondary power source (e.g., a small battery or the like), atleast temporarily. To facilitate this operation, the visioning device100, 102 may be provided with one or more ports allowing connection ofdifferent forms of power supplies. Also, status indicators (e.g., LEDsor other indicators) may be provided in to provide informationconcerning the imaging elements, communication elements, availablepower, etc. In some embodiments, haptic feedback may be used for variousindications, e.g., low battery, etc.

Frames 104 of various visioning devices 100, 102 may be fashioned from avariety of materials, including but not limited to plastics (e.g.,zylonite), metals and/or metal alloys, carbon fiber, wood, celluloseacetates (including but not limited to nylon), natural horn and/or bone,leather, epoxy resins, and combinations of the foregoing. Fabricationprocesses include, but are not limited to, injection molding, sintering,milling, and die cutting. Alternatively, or in addition, one or moreadditive manufacturing processes, such as extrusion, vatphotopolymerization, powder bed fusion, material jetting, or directenergy jetting, may be used to fashion the illumination device and/orcomponents thereof.

Activation/deactivation and/or other operation of the imaging elements,and/or audio communication elements of the visioning devices 100, 102may be effected through the use of integrated wearable modules 14 orattachable wearable modules 14, as applicable. Each of which may includea clench switch in the form of a Hall effect sensor or other sensor orswitch, as discussed above. The clench switch is responsive to minimaldisplacements of the wearer's masseter muscle, temple, or other facialelement, which the clench switch is positioned on or near when theassociated visioning device 100, 102 is worn, e.g., overlying the areaof the user's masseter muscle when the visioning device 100, 102 isworn, so that clenching/flexing of the wearer's jaw (or similarmovement) activates or deactivates the switch. The use of a clenchswitch overlying the area of the user's masseter muscle so thatclenching/flexing of the jaw activates the switch allows for hand-freeoperation of the imaging elements (and, optionally, other elements) ofthe device.

In visioning devices 100, 102 that include an integrated wearable module14, the clench switch is included at or near the end of a frame element106 that is a molded component of the original frame 104, with theclench switch being positioned by the frame element 106 so as to beflush against the wearer's face (or nearly so) over the masseter musclewhen the visioning device 100, 102 is worn so that clenching/flexing ofthe wearer's jaw activates the switch. In visioning devices 100, 102that do not include an integrated wearable module 14, an attachablewearable module 14 may be provided. The attachable wearable module 14include a buckle 108 that slides over a temple piece of frame 104 and anelongated member 110 that extends down from the temple piece to the areaof the wearer's face near the jaw line so that the clench switchincluded in the wearable module 14 at or near the end of the elongatedmember 110 is positioned over the wearer's masseter muscle. Thus, theattachable wearable module 14 may be provided as an after-marketaccessory for a visioning device 100, 102 not originally fitted withhands-free operating means. Whether included as a component of anattachable wearable module or an integrated wearable module, theposition of the clench switch may be adjustable, e.g., by providing atelescoping elongated member 110 or frame element 106, as applicable. Inthis way, the clench switch may be positioned at various distances fromtemple pieces of frame 104, so as to accommodate wearer's faces ofdifferent sizes.

As should be immediately apparent from these illustrations, use ofwearable module 14 allows activation/deactivation of the imagingelements, communications elements, and/or other elements of visioningdevices 100, 102 in a hands-free fashion. In some instances, elements ofvisioning devices 100, 102 may be controlled using wearable modules 14positioned on different sides of the wearer's face or by a singlewearable module 14 where the various elements are responsive tomulti-clench actuations of wearable module 14, as described above. Insome embodiments, the wearable module 14 may be hingeably attached toframe 104. This is useful to prevent unwanted actuations of the clenchswitch in that it can be moved away from or adjacent to the wearer'sface as required. Such a hinge arrangement may include a spring-loadedhinge that keeps the switch against the wearer's face even when thewearer moves his/her head unless moved away from the wearer's face by anamount sufficient to engage a detent that prevents return to a positionadjacent a wearer's face unless manually adjusted by the wearer. Thehingeable arrangement of wearable module 14 may involve a spring-loadedhinge of any type, for example a spring-loaded piano hinge, butt hinge,barrel hinge, butterfly hinge, pivot hinge, or other arrangement.

Thus, systems and methods for operating a controlled device in ahands-free manner through volitional jaw clench actions of a wearer, andin particular using an activation accessory for a controlled device thatincludes a vibration motor, a wearable module having a Hall effectsensor, and a communication element have been described.

What is claimed is:
 1. A head-worn unit, comprising: a frame with atemple piece; and a sensor module attached to the temple piece so as tobe slidably displaceable along the temple piece, the sensor moduleincluding a sensor configured to produce an output signal and a switchresponsive to muscle movement actions of a wearer of the head-worn unit,wherein the sensor is further configured to produce the output signalwhen the switch is depressed by said muscle movement actions of thewearer and the sensor module is positionable to allow the switch of thesensor module to contact the wearer when the head-worn unit is worn bythe wearer.
 2. The head-worn unit of claim 1, wherein the head-worn unitis a pair of eyeglasses that further includes lenses secured within theframe.
 3. The head-worn unit of claim 1, wherein the sensor comprises aHall effect sensor.
 4. The head-worn unit of claim 1, wherein the sensorcomprises an electromyography (EMG) sensor.
 5. The head-worn unit ofclaim 1, wherein the sensor comprises a piezo switch.
 6. The head-wornunit of claim 1, wherein the head-worn unit is a virtual reality unit oran augmented reality unit.
 7. The head-worn unit of claim 1, wherein thesensor is communicably coupled to a controller that includes a processorand a memory coupled to the processor, the memory storingprocessor-executable instructions, which instructions when executed bythe processor cause the processor to perform steps including: receivingthe output signal from the sensor; evaluating the output signal todetermine whether or not the output signal represents a command for acontrolled device by assessing the output signal for a signal patternindicative of volitional muscle movement actions of the wearer of thehead-worn unit; and if said processor determines that the output signalrepresents the command, then decoding the command and transmitting anassociated control signal for the controlled device, otherwise if saidprocessor determines that the output signal does not represent thecommand, not transmitting the associated control signal.
 8. Thehead-worn unit of claim 7, wherein the sensor is a Hall effect sensor.9. The head-worn unit of claim 8, wherein the head-worn unit is a pairof eyeglasses.
 10. The head-worn unit of claim 8, wherein the head-wornunit is a virtual reality unit or an augmented reality unit.
 11. Thehead-worn unit of claim 1, wherein the muscle movement actions of thewearer comprise volitional jaw movements.
 12. A head-worn unitcomprising: a frame having a member for securing the head-worn unit to ahead of a wearer; lenses secured by the frame, the lenses positioned infront of eyes of the wearer when the wearer is wearing the head-wornunit; and a sensor module adapted to be slidably positioned along atleast a portion of a length of the member, the sensor module configuredto produce an output signal responsive to volitional flexing of one ormore muscles associated with jaw clenching of the wearer.
 13. Thehead-worn unit of claim 12, wherein the sensor module comprises a Halleffect sensor.
 14. The head-worn unit of claim 12, wherein the sensormodule comprises an electromyography (EMG) sensor.
 15. The head-wornunit of claim 12, wherein the sensor module comprises a piezo switch.16. The head-worn unit of claim 12, wherein the head-worn unit is a pairof eyeglasses.
 17. The head-worn unit of claim 12, wherein the head-wornunit is a virtual reality unit or an augmented reality unit.
 18. Thehead-worn unit of claim 12, wherein the member comprises a temple piece.